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A Class of Tests for Multivariate Normality Based on 



Linear Functions of Order Statistics 
Murray A. Aitkin 

Macquarie University and Educational Testing Service 

SUMMARY 

A class of tests for normality using the ratio of two estimates of the 
standard deviation is generalized to provide a class of tests for multi- 
variate normality using a characterization of the multivariate normal. 

The powers of some of the tests are examined numerically and compared with 
the power of a recent similar test. 

1. INTRODUCTION 

Tests for normality based on the ratio of two estimates of the stan- 
dard deviation from a single sample have been proposed by several authors. 
We restrict attention here to those statistics using the usual estimate 
based on the sum of squares in the denominator, and an estimate based on 
a linear function of the sample order statistics in the numerator. Such 
statistics include the ratio u of range to standard deviation (David, 
Hartley, and Pearson, 195*0, Shapiro and Wilk's (1965) statistic W based 
on the best linear unbiased estimate of the standard deviation, and 
D'Agostino's (l97l) statistic D , based on Gini's mean difference. 

Similar statistics could easily be constructed from other order statistic 
estimators of the standard deviation, for example, the mean deviation 
about the median (Wair, 19^7) • 
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Malkovich and Afifi (1971) have generalized the V/ statistic to 
the multivariate case using an approximation to a union-intersection tost. 

In this paper we generalize the class of statistics described above 
to the multivariate case by a union intersection procedure different from 
that considered by Malkovich and Afifi. Percentage points for some of 
these statistics are obtained by empirical sampling. The empirical powers 
of the tests are examined for certain nonnormal alternatives considered by 
Malkovich and Afifi. 



2 . TESTS FOR NORMALITY 

Let X., < < ... < X be the order statistics in a sample of size n 

In — 2n — — nn 

2 

from a normal population N(ll, a ) , and let b., < b„ < . . . < b be a 

set of constants. The sample correlation" between the X. and the b. 

in in 

is 



n 

l < b i„ - 5 ><x ln - X) 

( E (b. - b) 2 E (X. - X) 2 ) 1 / 2 

x in ' ^ v in ' J 



where 



n n 

b = Eb ,/n , X = £ X, /n 

1 in 1 in 



4 
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Defining 



and defining 


a. = (b. - b)/{ E (b. - b) 2 ) 1 / 2 

in ' in '' 1 ' in ' ‘ ’ 




n 2 P 

Z (X. - X) = S 2 

^ in ' ’ 



the sum of squared deviations about the mean, we may express the "cor- 
relation" as 



where now 


n 

r(a,n) = E a. X. /s 

, in in' ’ 




n n 

2 a. =0 , E a. = 1 

1 in 1 in 



Several test statistics proposed for testing normality may be put 
in the above form* David, Hartley, and Pearson (195^) considered 





U=tlt nn - X lr)/ [s /( n ‘ 1 ^ ) 




= ( 2 (n - rfa^n) 



where a^ - (-2 f ,0,0, ...,0, 2 ^ ) . Shapiro and Wilk (1965) consider 



O 
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where 



W - r"(a 2 ,n) } 



-1 , t , -2 , 1/2 

= V m/{m'V m] ' , 



m and V being, respectively, the mean vector and covariance matrix of the 
vector of normal order statistics. D'Agostino (1971 ) considers 



D 



n 

Z (i 
1 



k (n + l))X 



in 



~ w ~ 

n 9 s 



= {(n 2 - lyW 2 } 1 / 2 r(a n) 



where 

a Jln , (i - § (n ♦ l))/(n(n 2 - l)/l2) l/2 • 

Pearson and Chandra Sekar (1936) consider 

T - - *>/ B 
« (" - l ) 1 ^ 2 rfa^n) , 

where 



a 4in 



-{n(n - l)) ^ 2 , for i / n , 

J(n - lj/n) 1 ^ 2 , for i = n 
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Other such statistics can easily be constructed. For sample, hair 



(19^7) considers m 1 , the mean deviation about the median, as an estimate 
of 0 : 



Let X be a p -component random vector. It is well known (see, for 
example, Anderson, 1958) that X is multivariate normal if and only if every 
linear function £’X is univariate normal, where jL is an arbitrary fixed 
vector. We use this property to construct a union-intersection test for 
normality. 

Let X^, • . . ,X n be a random sample from a population. Let £ be an 
arbitrary fixed vector, and define 



n 



k 




where v is the sample median, and k = — if n is odd, k -• 

if n is even. A test for normality could then be based on 




3. TESTS FOR MULTIVARIATE NORMALITY 



Z*. ^’X. 

1 L i 



i - 1 , • ■ -,n , 



the dependence of Z* on £ being understood. Let the ordered Zi? be 



denoted by Z* < ... < Z* . We construct any of the statistics 
In — - nn J 




n 



z* /{/’sjO 1 / 2 

i in' i £ 
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* 



where 



It. is clear th-. t .such 



-O- 

5 is the matrix of sample cross-products, 
statistics are origin and scale invariant for all ji , i.e., do riou 
depend on and . £ £ for all j L , where p and E are the- mean 

and covariance matrix of X . Hence they do not depend on p and E . 
Without changing the problem., we may therefore make a linear transformation 

Y = AX + b , 

where A is a p x p positive definite matrix and b an arbitrary 
vector. Take A = S' 1 / 2 and b = S _1 / 2 X, where S 1 / 2 is the (unique) 
symmetric square root of S , so that 

Y. = S’ 1 / 2 ^. - X) . 

The components of Y ± are then scores on standardized principal component 

variables with Y - 0 , E(Y - Y)(Y - Y)' = I . Define 

i 1 

Zi = £’Ii i - 

and denote the ordered Z. by Z- < . .. < Z . Then we consider the 

i in — — nn 

statistics 

r(a, l, n) = Z . , 

For different choices of a , a one-sided or two-sided test may be appro- 
priate (for example, the test based on W is one-sided, but that based on 
u two-sided). If small values of r(a,£,n) are significant, we do not 
reject at level a the hypothesis of normality of P'X if 

r L (a,n) < r(a, /, n ) . 
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A size a union-intersection test fcpr the hypothesis of multivariate normality 
of X will not reject if 

c L _a (^ n ) < r (s:> L n ) 



for all £. , so that 



inf r(a, £, n) > c^'" Q: (a,n) 

i " L - 






1_Q> 

where (a, n) is the lower 100Q! per cent point of the distribution of 

inf r(a, £, n) . A conservative two-sided test at level a may oe obtained by 

L 

not rejecting the normality hypothesis when 



inf r(a, 

L ~ 

sup r(a, 

L 



L> n) > c J"°^ 2 (a»n) 
£> n) < c“/ 2 (a,n) 









where Cy(a,n) 
sup r(a, [, n) 

l 



is the upper 100a per cent point of the distribution of 



k. SUP r AND INF r FOR p =2 

Consider first the case p = 2 . The linear function Z = £' Y is then 
£ 1 Y 1 + 1^2 ' Since r(a, jb , n) is independent of scale, we may assume without 
any loss of generality that /^ = 1 , = / , since it is only the ratio 

that matters. (We might instead set £_ = sin 0 , />, = cos 6 and map each point 
into a trigonometric function. Such a procedure has been used by Andrews 
(1971) in another context. The results are equivalent for p = 2 , but 
for p >2 the polar transformation becomes less convenient.) We consider 
therefore the values 
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Y n + 



Z n = Y ln + 



Ihn 



These may be plotted as n lines in the (Z,fc) plane. The n lines 

intersect in N = (£) points, defining N values of /, < • • • < / 

(some of which may be coincident). The points define N • 1 regions 

L j = ^ : ^j-i < / - ^ * j = 1, ...,N 4 1 , where ff Q ■ -» , = oo 

The regions L have .the property that the ordering of the Z. = ff'Y. 

** x i. — i 

is the same for all |6 L. , 

A J 

Now in the region L. , let the ordered Z. be 

J i 



Z" < ... < 7? 

In — — nn ’ 



and write 



7?. = Y^. + fa? 

in lx * : 



2i 



Then for / 6L. , 
A J ’ 



r(a, [, n) = r(a, jf, n) = ( Z a.^. + £ X )/(l + f) 1 / 2 



in 2i' 



= (s n J + ysg)/(i + If 2 ) 1 / 2 



where 



n 

S*J = £ a. Y; 3 . 
k ^ in ki 



k = 1,2 



Now 



inf r (a, (, n) = inf inf r(a, /, n) , 

/ 3 /'>'j 
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and for / G L. , r(a, (, n) is the ratio of a linear form to the square 
root of a positive definite quadratic form. It is well-known that this 
ratio, for unrestricted j( , has only one extreme value, a maximum equal to 




which occurs when L = 4/ s l 



llenc e 



inf r(a, /, n) = inf r(a, /., n) 

£ j 3 

^ , the supremum of r(a, j^, n) will also occur at 

an C • If £ = Sp/s^? E L , write j(* = S^/S^ , and then 

S ^P r (§, £, n) = sup ( r (a, j , n), r(a, /* , n)} 

X j J J 



REMARK 

The supremum simplifies considerably for the u statistic of David, 
Hartley and Pearson and for the t statistic of Pearson and Chandra Sekar. 
We have 



sup r u = sup Hs^.L ") = 



and if we use the normalization r l = i , 
S V.P r „ = 2 ~ 1 ^ s up(Z nn - Z ln ) 



i u 



i 



Thus sup is a multiple of the greatest distance between the projections 

L 

of any two points Y.,Y. ,, on the hyperplane Z = j( f Y . The distance will 

- 1 — j — 

be greatest when the hyperplane passes through the two points which are 
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at the diameter of the convex hull of the points 



farthest apart, i.e., 



Y , . . . , Y . Thus 
-1 -n 



3 up r 

l U 



= f^supKY. - Y )’(Y - Y J} 1 ^’ 

= 2' l/LJ sup((X - X . ) ' S _1 (X . - X .)} 1 ^ 

i,j J 3 



in terms of the original variables. 
Similarly, 



sup r T = sup r(a^, £, n) 
A. L 



- (1 - S>' 1/2 (Z nn /(1'I) 1/2 ) 

L 



and taking /'Jf = 1 as above. 



sup r = (l - — ) sup Z 

£ T n ± m 



Thus sup r is a multiple of* the greatest distance from the origin of the 

i 7 

projection of any point on the hyperpiane Z = j_'Y . This distance will be 
greatest for the point furthest from the origin. Thus 

sup r = (1 - h‘Y 2 8up[YU i ) Y 2 

t i 

= (1 - ij-^supK^- D'S’V -X)) 1 / 2 

i 

in terms of the original variables. These results hold for all p , but no 
corresponding results hold for inf r or inf r 

l U 1 7 

in general, since the other statistics do not have a simple distance inter- 
pretation. Thus for r^ , no explicit calculation of the supremum is 



, or for sup r(a, (, n) 

i 
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necessary, for it must occur for one of the vectors ^ already required for 
the infimum. For r^ , the explicit calculation is necessary unless - Y 
for some i . 



5. AN EXAMPLE 



Below appears part of Student's data on the number of hours increase in 



sleep gained from the use of two drugs (Anderson, 1958, P* 5l)* Eor simplicity 



we have taken only the first five 
Patient Drug A (X^) 


subjects. 
Drug B (X 2 ) 


Y 1 


Y 2 


1 


1-9 


0.7 


0.58592 


0.50966 


2 


0.8 


- 1.6 


0.2339^ 


-O .68989 


3 


1.1 


- 0.2 


O.I 8796 


0.10817 


4 


0.1 


- 1.2 


-0.33245 


-0.31752 


5 


- 0.1 


- 0.1 


-0.67537 


0.38958 



The matrix of sample cross products S is 
S = 



to 

2.592 


1.544’ 


> 


11 

C\J 
1 — l 
CO 


0 . 704,134 


- 0 . 183 , 7 ^ 7 " 


1.544 


3.388. 






_-o. 183,727 


0. 609 , 4l4 



while X' = (O. 76 , -0.48) . The principal component scores Y. = S (X . - X) 
are given above in the columns Y n , Y p . The ( p ) = 10 points of intersec- 



tion are obtained by solving simultaneously the pairs of equations 

J 



giving 









i / t i = 1, . . . , 5 
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(lf Y„. - Y 0 should be zero, Z is defined by Z. - Y... . ) The 10 values 

^0 l 2i ' 

of J ^ , ordered from smallest to largest, are 



- 10.50375 


O.O 576 I 


-1.22231 


0.48497 


-1.11024 


0.84237 


-0.99121 


1.52104 


- 0 . 29343 


3.06787 


Suppose we wish 


to find su' 



7 u 



Taking the value 

= -10. 50375 , corresponding to the intersection of and Z,_ , the Z^ 
are -4.76742 , 7.48037, -0.94823, 3.00270, -4.76742. Then Z^ - Z^ = 12.24779 , 
{2(1 + X- = 14.92171 , r(a^, n) = 0.8208 . On repeating the calcula- 

tion for the other nine values of / , the following r values are obtained; 



.8208 .8953 
•9979 -8395 
•9975 -8735 
.9940 .8455 
.8319 -8836 



To test for a local maximum in , the ordering of the Z^: Z^ < Z,_ < 



Z^ < Z^ < Z^ defines the orderings 



O.58592 

-0.67537 

O.I8796 

-0.33245 

O.23394 



O.5O966 

O.38958 

0.10817 

-0.31752 

-O.68989 



1 1 

of Y and respectively. The corresponding values of and S2 are 



2“ 1 / 2 (0. 23394 - O.58592) = -0.24889 and 2~ J 7 c (-0. 68989 - 0.50966) = -0.84820 

respectively. Then / = S^/S^ = 3.40795 (p . Hence there is no local 

maximum for / G L- . On repeating this procedure for the other L. , 

J- 3 

only one local maximum occurs, namely r = 0.8740 when = O.9OO7O in 



- 1 / 2 , 



L . This does not yield a global maximum, so that 
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inf r(a., /, n) = .8208 at / = -10.50375 , 

/ ~ x 

sup r(a. , /, n) = -9979 at jf = -1.22251 . 

t 

To verify the supremum in this case, we note that 

2" 1/2 ((X 2 - I 5 )’(Y 2 - h )) l/2 = -9980 , 



which agrees with the above result within round-off error 



6. GENERAL p 



The argument in can be extended directly to any p . Without loss 

-l/2 

of generality we consider the standardized principal variables Y^ = S ' (>L 

and again take jbhe linear function ^'Y as Y^ + + ••• + ^p-i^p ’ 

values Z. = Y, . + /, Y„. + ... + / -,Y . . now define n hyperplanes. These 
x li '1 2i '•p-l pi 

intersect p at a time in ( n ) points, defining (^) values of , which 

p P 

then define regions with the property that the ordering of the Z^ is fixed 

in each region. Again the infimum of r(a, /, n) will occur at one of the 

vertices of the region, and the supremum will occur either at one .of these 

points, or at a local maximum if one occurs in a region, the maximum then 
p .p 1/2 . . n 

being ( £ ) , occurring when = S^/S^ , where = Z > 

k=l 1 

k = 1, ...,p , the j superscript denoting the j -th region. 

However, the ordering of the Z^ at each of the (^) values of £ 
becomes a major computational problem for p > 2 . For p = 2 , it is neces- 
sary to order the Z^ only once, for if the ordering in (say) Lq is 
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ostablished, then it is known that in L ] _ , the ordering of .just two observa- 
tions is interchanged from that in L Q , and these observations are identified 
by the original determination of • Thus the ordering of the in eveiy 

L can be obtained with just one ordering. This does not happen for V > ^ > 

j 

however, essentially because the points cannot be ordered on one dimension. 

The ordering must therefore be recalculated at each of the ( y values of (, 
a very time-consuming process. Some saving in time is possible for r^ , for 
this requires for each only the maximum and minimum Z , not a complete 
ordering. 

We therefore consider an alternative procedure. Let 



Z = Y, + jfY p + / Y, + . . . + / 






Then Y is mapped into a polynomial in the (Z ,/) plane. The results of 
§4 may now be extended with some changes, but we note that all possible linear 
functions Y cannot be generated in this way. Thus this procedure may be 
less powerful against certain kinds of departures from normality than one 
which considers all linear functions. 

The n polynomials Z^ now intersect two at a time in p - 1 points, 
defining (p - l)(g) points / (some of which may be coincident or imaginary, 
corresponding to complex roots in / of - Z. = 0 ). The regions L. are 



defined as before, and in L. , 

J 



r(a, 1, n) = ( S sj / k_1 )/( E / 2 ( k_1 ^ 



k=l 



1/2 

) 



k=l 



Further complications now arise as this function has multiple maxima and 
minima. We shall ignore these however and consider only the points / . 
defined above. Again this may result in some loss of power: this question is 

examined in §8. We thus evaluate 
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O 
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inf r(a, n) 

L 3 

and. sup r(a, jf., n) , 

/. J 

h J 

and accept or reject the hypothesis of multivariate normality accordingly. 



7. OTHER TESTS FOR MULTIVARIATE NORMALITY 



Tests for multivariate normality have recently been considered by 

Malkovich and Afifi (l97l)> in a study including the tests discussed in 

Kowalski (1970) and some others. In particular, they generalize the skewness 

l/2 

and kurtosis statistics b^' and b^ to the multivariate case by a union- 
intersection argument. Shapiro and Wilk's W is also generalized, but by a 
procedure different from that described in §4 and §6. Rather than obtaining 
the infimum of W over all linear functions j£'X , they consider the linear 
function /'X which produces a value of^ W as close to its lower bound as 
possible. It is known (see Shapiro and Wilk ( 1965 ) for details) that W 
attains its lower bound when 

Xj - X - (n - l)/(na ln ) , 

\ - X = -l/(na ln ) , 

for i = , i / j , for any j . Malkovich and Afifi consider the 

vector / which minimizes 

[/'(X -X) - (n - l)/(na ln )] 2 + Z [f (X. - X) + l/(na ln )] 2 , 

J ifd 



which is 



L = S _1 (X - X)/e 



In 
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Since j may take any value from 1 to n , X . is chosen to maximize the 

J 

denominator of W . Thus let m be such that 

(X m - X)’S' 1 (X m -X) = max (X - Xj’S'^X - X) . 

lsj<n J J 

Let the ordered values of 

U. = (X. - X) , S" 1 (X - X) 

J ~3 ~ -m 

be U, < . . . < U . Then the Malkovich-Afifi statistic is 
In - — nn 

W = [Za. U. ] 2 /(X - X)'S _1 (X -X) 

p in in ; ' x -m — ' 

If we use the standardized principal variables 
Y. = S _1 / 2 (X. - X) , 

-l N — l — ' 3 



this reduces to 



where 



W = [Za. V. 1 2 /Y’ Y 
p in in m -m 



V. = Y’. Y , 
3 ~3 "Hi 



V, < . . . <V are the ordered V. , and m is such that 
in — — nn j 



Y’Y = max Y’.Y. 

Ifjfn 

The null distributions of the statistics r described in §4 and S6 
seem analytically intractable, as the corresponding univariate statistics 
in general do not have simple forms, and the multivariate statistics are 
obtained by data-based linear functions of X . Percentage points of the 
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i 







statistics were therefore obtained by simulation, using samples of $00. A 
more accurate table of percentage points is in preparation, but the results 
from samples of ^00 should give a clear picture of power properties- 

8. POWER RESULTS 



Approximate lower percentage points of Malkovich and Afifi's W 



P * 

0f W min = i £ f r2 ^-2’^ n ^ ’ and of U m in = ^ 2 ( n " ^ ir j? r (^p ; iC n ) > 

3 /2 

and approximate upper percentage points of u = {2(n - l)) ' sup r(a 1 ,j(, n) 

TT13.X £ “1 

were determined by generating 500 samples for p = 2 , n = 10,20 , and 
p = 5 , n = 10 , at values of Ot = .01, .02, .025, -05(»05).25 • In 



addition, approximate percentage points of W*^ n , u ^ n > 



and u* were 
max 



determined for p = 3 , n = 10 and the same values of a , where the 
asterisk indicates the use of a polynomial mapping rather than a hyperplane 
mapping of X . 

The powers of the above tests were then determined against the 
following, distributions. 



P = 2 : 



LN 

U 



N 



t 



k 




N - U 



bvn(. 5, • 5) 

BVTJ(.75, -5) 



X^ independent log normal 
X^ independent uniform 
X^ independent t^ 

X. independent t^Q 

X^ normal, Xg log normal, X^, X£ independent 
X^ normal, Xg uniform, X^, independent 
X^ normal, Xg t^ , X^, X^ l nc iependent 

X^ normal, Xg t ^ , X^, independent 

(X^,X^) mixture of bivariate normals 
where BVW(p, p) has density 
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• m- p ( v >: 2 ) i (i - . 

where 

f pW , X 2 ^ = ( 2jt ) 1 ^ 1 " p2 ^ 1 / ? ex !'{"( y i ■ 2 P 7 i *2 "* >: 2^ 2 ^ 1 " p2 ^ 
p = 3 : LN , U , t 1Q . 

In Table 1 appear the results for a = .10 , p = 2 } n = 10 and 20 . 
Other values of Oi gave comparable results 

TABLE 1 



EMPIRICAL POWERS FOR 


a = .10 , 


y 

ii 

ro 


n = 10 AND 


20 






o 
1 — 1 

It 

c 










w 

_E 


w . 

min 


u . ,u 
min' max 


W 


u 


LN 


•75 


•78 


.21 


•72 


• 15 


U 


.08 


.12 


.18 


• 15 


• 32 


\ 


• 50 


.26 


•17 


• 23 


•17 


t „ 


.18 


.14 


• 13 


• 13 


• 13 


10 












N-LN 


•55 


• 54 


• 13 






N-U 


• 15 


.14 


•19 






N-t 4 


.20 


.16 


.14 






N - t io 


• 15 


.16 


• 15 






BVN(-5, -5) 


• 15 


• 15 


• 13 






BVN(-75,-5) 


.14 


.12 


.12 










n = 20 










w 


W . 


u . , u 








J2. 


mm 


min' max 


W 


u 


LN ' 


•97 


•99 


.47 


.96 


.14 


U 


.05 


.22 


• 51 


•59 


• 55 


H 


• 58 


• 56 


• 53 


•27 


.24 


ho 


• 50 


•25 


.21 


.18 


.14 


N-LN 


.81 


•87 


.22 






N-U 


•09 


.18 


•54 






N-t^ 


. 26 


.24 


.21 






N -ho 


.23 


.22 


.21 






BVN(.5,-5) 


•17 


.16 


.18 






BVW(-75,-5) 


. 16 


.14 


• 15 
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The columns headed W and u give the empirical powers for n --- 10 



and 20 


in the 


univariate case for W 


and 


u j reproduced 


from Shapiro, 


Wilk and Chen 


(i 9 68 ). 


The results for 


a = 


.10 , pO , 


n = 10 


are 


given 


in Table 


2 . 


TABLE 


2 










EMPIRICAL 


POWERS FOR a = 


.10 , 


P = 3 J n - 


10 






W 

_P 


w . 

am 


u . . u 
min ; max 


V/*. 

min 


u* . , u* 
min' max 


W 


u 


LN 


.64 


.64 


.18 


. 62 


.14 


.72 


• 13 


U 


..09 


.11 


.10 


.14 


•15 


•15 


• 32 


t 10 


.16 


.14 


.11 


.17 


.14 


• 13 


• 13 








9. CONCLUSIONS 









The power of W . was generally very close to that of W over the 
* min p 

range of bivariate distributions considered, except for the bivariate 

uniform distribution where the W test appeared to be biased. The 

P 

bivariate u test was much less powerful for skewed distributions, but 
superior for the bivariate uniform or normal-uniform. These results are 
not unexpected reflecting similar performances for W and u in the uni- 
variate case. In the trivariate case. W and W . were equivalent, 
and again superior to u for the lognormal, although for the uniform and 
t^Q alternatives all tests had very low power for n = 10 . The powers 
for the W* and u* tests based on polynomial mappings were very close to 
those of the tests based on hyperplane mappings, suggesting that the simpler 
polynomial mappings may be quite satisfactory. 
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I am grateful to L. J. Gleser and J. A. Hartigan for helpful comments, 

and to Dorothy Thayer for the programming. A program to obtain W and 

u . , u may be obtained from Mrs. Thayer, Division of Data Analysis 
min max 

and Research, Educational Testing Service, Princeton, N.J. 085^0. 
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